Search AI Products and News

The VFusion3D AI model, developed in collaboration with the University of Oxford, can transform a single 2D image or text into high-quality 3D objects, having a profound impact on the fields of virtual reality, gaming, and digital design. This model effectively addresses the scarcity of 3D training data by generating synthesized 3D data through pre-trained video AI. In practical tests, VFusion3D performed excellently compared to leading systems, with over 90% of human evaluators preferring its generated 3D reconstructions. VFusion3D can transform input in just seconds.

Scientists at ShanghaiTech University have developed CLAY, an AI model that can generate detailed 3D objects from text or 2D images, outperforming earlier technologies in quality, diversity, and generation speed. At its core, CLAY includes a multi-resolution variational autoencoder and a diffusion transformer, allowing direct processing of 3D content without conversion. By training on over 500,000 3D models, CLAY can produce objects ranging from everyday items to complex creatures and achieve precise control through additional inputs, generating urban scenes and reconstructing 3D models from sketches.